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DETAILED ACTION 

1 . This communication is responsive to Amendment filed 1 /1 8/2006. 

2. Claims 1-28 are pending in this application. Claims 1, 12, 23 and 25 are 
independent claims. This action is made non-final. 



Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 1-23,25-28 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Edgar et al ("Edgar 7 ', US 5,537,530) in view of Liou et al ("Liou", US 6,278,446). 

As per independent claim 1 , Edgar teaches a computer-implemented method for 
organizing a sequence of video frames, comprising 

selecting one of the frames in the sequence as an initial frame in a first portion of 
a segment of the sequence (Edgar, col. 4, lines 43-49); 

adding further frames in the sequence, subsequent the initial frame, to the first 
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portion, while a measure of similarity of each of the added frames to the frames already 
in the first portion is within a first predefined bound (Edgar, col. 4, lines 57-61); 

selecting one of the added frames in the first portion to be a representative frame 
for the segment (Edgar, col. 4, lines 57-61 ); .and 

generating a second portion of the segment by adding automatically, under 
control of computer program instructions and without intervention by a user (col. 3, lines 
34-38; col. 7, lines 59-63), still further frames in the sequence, subsequent to the last 
frame in the first portion, to the second portion, (Edgar, col. 4, lines 57-61 ; col. 7, lines 
56 - Column 8 line 1, likelihood value for scene boundary is measured in terms of an 
image similarity metric or coordinates of the images in a parameter space); and 
determining the first and second portions together to constitute the segment that is 
represented by the representative frame (Edgar, col. 5, lines 1-5). Edgar fails to 
distinctly point out determining a similarity between the r-frame and other frames. 
However, Liou teaches a method for determining that the measure of similarity of each 
added frame to the representative frame is within a predefined bound (Figure 11). 
Therefore it would have been obvious to an artisan at the time of the invention to 
combine the teaching of Liou with the method of Edgar. Motivation to do so would have 
been to provide a meaningful video organization. 



As per claim 2, which is dependent on claim 1, Edgar-Liou teaches a method 
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according to claim 1 , wherein selecting the frame as the initial frame comprises 
selecting the first frame subsequent to a final frame in a preceding segment (Edgar, 
col.5, lines 39-43). 

As per claim 3, which is dependent on claim 1, Edgar-Liou teaches a method 
according to claim 1 , wherein adding the further frames comprises, for each of the 
added frames, computing at least one parameter indicative of a characteristic of the 
added frame, and wherein the measure of similarity comprises a distance measured 
between the parameters of the added frame and the frames already in the first portion 
(Edgar, col.8, lines 12-16). 

As per claim 4, which is dependent on claim 3, Edgar-Liou teaches a method 
according to claim 3, wherein computing the at least one parameter comprises 
computing a vector of parameters, and wherein the distance comprises a vector 
distance (Edgar, col. 8, lines 12-16). 

As per claim 5, which is dependent on claim 3, Edgar-Liou teaches a method 
according to claim 3, wherein adding the further frames comprises finding a bounding 
subset of the frames in the first portion, and adding the further frames to the first portion 
while the distance between each of the added frames and the frames in the 
representative set is within the predefined bound (Edgar, col. 4, lines 57-61; col. 8, lines 
12-16). 
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As per claim 6, which is dependent on claim 5, Edgar-Liou further teaches a 
method according to claim 5, wherein finding the bounding subset comprises selecting 
the subset so as to maximize a sum of the distances between all of the frames in the 
subset (Edgar, col. 8, lines 55-62; Table 2; col.9 t lines 50-55). 

As per claim 7, which is dependent on claim 6, Edgar-Liou further teaches a 
method according to claim 6, wherein selecting the subset comprises determining the 
sum of the distances between one of the further frames added to the sequence and the 
frames in the bounding subset, and replacing one of the frames in the subset with the 
one of the further frames if replacing the one of .the frames in the subset will increase 
the sum of the distances between all of the frames in the subset (Edgar, col. 9, lines 56- 
67; col. 10, lines 50-67). 

As per claim 8, which is dependent on claim 1, Edgar-Liou teaches a method 
according to claim 1, wherein selecting the representative frame comprises selecting a 
final one of the frames added to the first portion to be the representative frame (Edgar, 
col. 4, lines 57-61). 

As per claim 9, which is dependent on claim 8, Edgar-Liou teaches a method 
according to claim 8, wherein the frame in the sequence following the representative 
frame is outside the first predefined bound of the frames in the first portion (Edgar, col. 
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5, lines 1-5). 

As per claim 10, which is dependent on claim 1, Edgar-Liou teaches a method 
according to claim 1, and comprising storing the sequence in an archive, and indexing 
the archive using the representative frame (Edgar, col. 5, lines 6-13). 

As per claim 1 1 , which is dependent on claim 1 , Edgar fails to teach a method 
according to claim 1, and comprising compressing the sequence using the 
representative frame. However, OFFICIAL NOTICE is given that compressing video 
data and using a representative frame, or thumbnail, is well known in the art. It would 
have been obvious to one skilled in the art at the time of invention to include the ability 
to compress the video data in the invention of Edgar because it would reduce the 
amount of space needed to provide for the program, therefore making it more efficient. 



Independent claims 12 and 23 are similar in scope to claim 1, and are therefore 
rejected under similar rationale. 

Dependent claim 13 is similar in scope to claim 2, and is therefore rejected under 
similar rationale. 

Dependent claim 14 is similar in scope to claim 3, and is therefore rejected under 
similar rationale. 

Dependent claim 15 is similar in scope to claim 4, and is therefore rejected under 
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similar rationale. 

Dependent claim 16 is similar in scope to claim 5, and is therefore rejected under 
similar rationale. 

Dependent claim 17 is similar in scope to claim 6, and is therefore rejected under 
similar rationale. 

Dependent claim 18 is similar in scope to claim 7, and is therefore rejected under 
similar rationale. 

Dependent claim 19 is similar in scope to claim 8, and is therefore rejected under 
similar rationale. 

Dependent claim 20 is similar in scope to claim 9, and is therefore rejected under 
similar rationale. 

Dependent claim 21 is similar in scope to claim 10, and is therefore rejected 
under similar rationale. 

Dependent claim 22 is similar in scope to claim 1 1 , and is therefore rejected 
under similar rationale. 

Claim 25 is similar in scope to that of claim 5 and is therefore rejected under 
similar rationale. 

Claim 26 is similar in scope to that of claim 6 and is therefore rejected under 
similar rationale. 

Claim 27 is similar in scope to that of claim 18 and is therefore rejected under 
similar rationale. 

Claim 28 is similar in scope to that of claim 9 and is therefore rejected under 
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similar rationale. 



Claim 24 is rejected under 35 U.S.C. 103(a) as being unpatentable over Edgar et 
al ("Edgar, US 5,537,530) and Liou et al ("Liou", US 6,278,446) in view of Toklu et al 
("Toklu", US 6,549,643). 

As per claim 24, which is dependent on claim 5, Edgar-Liou specifically fails to 
teach a subset comprising of at least three frames. However, Toklu teaches a method 
wherein the bounding subset comprises at least three of the frames in the first portion 
(Toklu, Column 9 lines 52-54). Therefore it would have been obvious to an artisan at the 
time of the invention to combine the at least three frame teaching of Toklu into the 
method of Edgar-Liou. Motivation to do so would have been to ensure a big enough 
sample to choose a representative frame without all three frames being the same. 



Response to Arguments 

Applicant's arguments with respect to claims 1-28 have been considered but are 
moot in view of the new ground(s) of rejection. 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Ryan F. Pitaro whose telephone number is 571-272- 
4071 . The examiner can normally be reached on 7:00am - 4:30pm M-Th, and 
alternating F. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Kristine Kincaid can be reached on 571-272-4063. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-21 7-91 97 (toll-free). 

Ryan Pitaro 
Art Unit 2174 
Patent Examiner 
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